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ABSTRACT 


Discrete  orthogonal  functions  are  used  in  adaptive  system 
identification  algorithms.  Adaptive  filters  are  realized  by 
forming  linear  combinations  of  discrete  Legendre,  Laguerre, 
and  Jacobi  polynomials,  and  backward  prediction-error 
polynomials  from  a  lattice  structure.  The  adaptive  filter 
weights  are  updated  using  the  LMS  algorithm.  FIR  and  HR 
bandpass  filters  are  modeled  using  the  adaptive  filters,  and 
performance  comparisons  are  made. 


Fo;  ^ 

NT\S 

CPASI 

DL-: 

TAJ  Lj 

Ij 

01  r  [  1 

J,. 

By 

Dfa.  It) 

.  ilO:’,  / 

■ 

A 

Coe:.'. 

Avo  i  ;  0' 

Di.t 

bp-.-c,-*! 

ft'l 

! 

1 

Ill 


TABLE  OF  CONTENTS 


I.  INTRODUCTION  .  1 

A.  ADAPTIVE  SYSTEM  IDENTIFICATION  ALGORITHMS  ...  1 

B.  THESIS  OUTLINE  .  2 

II.  ORTHOGONAL  FUNCTIONS  .  3 

A.  THEORY  OF  ORTHOGONAL  FUNCTIONS  .  3 

B.  CLASSICAL  ORTHOGONAL  POLYNOMIALS  .  5 

C.  ORTHOGONALITY  OF  THE  LATTICE  PREDICTOR  ....  7 

III.  SYSTEM  IDENTIFICATION  AND  MODELING  .  8 

A.  ORTHOGONAL  ADAPTIVE  FILTER  MODEL  .  8 

B.  LEGENDRE  POLYNOMIALS  .  11 

C.  JACOBI  POLYNOMIALS  .  15 

D.  LAGUERRE  POLYNOMIALS  .  20 

E.  LATTICE  PREDICTOR  .  22 

IV.  SIMULATION  RESULTS  .  25 

A.  FIR  BANDPASS  FILTER  SIMULATIONS  .  25 

B.  HR  BANDPASS  FILTER  SIMULATIONS  .  32 

V.  CONCLUSIONS . .  .  38 

A.  LIMITATIONS  OF  ORTHOGONAL  FILTER  MODEL  ....  38 


IV 


B.  RECOMMENDATIONS  FOR  FURTHER  RESEARCH  .  40 

LIST  OF  REFERENCES .  41 

INITIAL  DISTRIBUTION  LIST  .  42 


V 


LIST  OF  FIGURES 

Figure  3.1:  System  identification  configuration  ...  8 

Figure  3.2:  Generic  adaptive  filter  configuration  for 

orthogonal  functions .  10 

Figure  3.3:  Module  of  Legendre  polynomial  adaptive 

filter .  16 

Figure  3.4:  Module  of  Laguerre  polynomial  adaptive 

filter .  22 

Figure  3.5:  Lattice  predictor  adaptive  filter .  24 

Figure  4.1:  Impulse  and  frequency  response  of  an  18^^ 
order  Legendre  ADF  used  to  model  a  22"'^  order  FIR 

filter .  26 

Figure  4.2:  Impulse  and  frequency  response  of  a  52'^'^ 

order  Legendre  ADF  used  to  model  a  71®'  order  FIR 

filter .  26 

Figure  4.3:  (a)  Convergence  of  first  six  expansion 

coefficients  and  (b)  Output  error  for  an  18'^  order 
Legendre  ADF  used  to  model  the  22'"^  order  FIR 

system .  27 

Figure  4.4:  Impulse  and  frequency  response  of  an  18"' 

order  Laguerre  ADF  used  to  model  a  22"^^  order  FIR 

filter .  28 


VI 


Figure  4.5:  Impulse  and  frequency  response  of  an  52"*^ 

order  Laguerre  ADF  used  to  model  a  71®^  order  FIR 

filter . 

Figure  4.6:  Impulse  and  frequency  response  of  a  15^^ 

order  Jacobi  ADF  used  to  model  a  22"^^  order  FIR 

filter . 

Figure  4.7:  Impulse  and  Frequency  response  of  a  15^^ 

order  lattice  ADF  used  to  model  a  22"'^  order  FIR 


29 


29 


filter 


31 


Figure  4.8:  Impulse  and  frequency  response  of  a  52"'^ 

order  lattice  ADF  used  to  model  a  order  FIR 

filter . 

Figure  4.9:  Impulse  and  frequency  response  of  a  15^^ 

order  Legendre  ADF  used  to  model  a  7^^  order  HR 

filter . 

Figure  4.10:  Impulse  and  frequency  response  of  a  65^*^ 

order  Legendre  ADF  used  to  model  a  31^^  order  HR 

f liter . 

Figure  4.11:  Impulse  and  frequency  response  of  a  15^^ 

order  Laguerre  ADF  used  to  model  a  7^^^  order  HR 

filter . 

Figure  4.12:  Impulse  and  frequency  response  of  a  65^^ 

order  Laguerre  ADF  used  to  model  a  31^^  order  HR 


31 


33 


33 


34 


filter 


35 


Figure  4.13:  Impulse  and  frequency  response  of  a  IS^'^ 

order  Jacobi  ADF  used  to  model  a  7^^  order  HR 

filter .  35 

Figure  4.14:  Impulse  and  frequency  response  of  a  IS^'^ 

order  lattice  ADF  used  to  model  a  7^^  order  HR 

filter .  36 

Figure  4.15:  Impulse  and  frequency  response  of  a  65^^ 

order  lattice  ADF  used  to  model  a  31^’^  order  HR 
filter .  37 


viii 


I. 


INTRODUCTION 


A.  ADAPTIVE  SYSTEM  IDENTIFICATION  ALGORITHMS 

Adaptive  FIR  and  IIR  digital  filters  are  widely  used  in 
system  identification  algorithms.  The  extensive  use  of  IIR 
adaptive  filters  has  been  hindered  by  several  problems: 
(1)  Instabilities  encountered  in  their  design;  (2)  Local 
minimums  in  the  mean  square  error  surface;  and  (3)  Slow 
convergence  rates  of  the  adaptive  filter  weights  [Ref.  1], 
Although  FIR  adaptive  filters  do  not  suffer  from  the  problems 
that  ail  IIR  adaptive  filters,  they  typically  require  much 
larger  orders  to  effectively  model  a  given  system. 

Using  orthogonal  functions  in  system  identification 
algorithms  was  first  employed  by  Lee  in  1932  [Ref.  2]. 
Adaptive  filters  based  on  orthogonal  functions  have  several 
advantages,  namely,  they  are  always  stable  and  have  an 
infinite  impulse  response,  making  their  use  ideal  for  modeling 
system.s  with  long  impulse  responses.  Additionally,  the  FIR 
adaptive  filter  weights  converge  faster  than  those  associated 
with  an  IIR  filter  structure  due  to  the  uniroodal  mean  square 
error  surface.  The  filter  is  realized  by  forming  linear 
combinations  of  discrete  orthogonal  functions,  which  are 
weighted  to  minimize  the  mean  square  error  of  the 
approximation . 


B.  THESIS  OUTLINE 

A  brief  description  of  contents  of  the  remaining  chapters 
follows.  Chapter  II  introduces  the  theory  of  orthogonal 
functions  and  their  use  in  modeling  linear  systems.  The 
definitions  of  the  orthogonal  functions  included  in  this 
research  are  given.  Chapter  III  develops  the  actual  adaptive 
filter  model  that  utilizes  the  orthogonal  functions  for  system 
identification.  The  derivation  of  the  filter  weights  is 
discussed  in  detail;  significant  development  of  the  discrete 
orthogonal  functions  is  shown.  Chapter  IV  presents  the 
simulation  results  of  the  various  filters  developed  in  chapter 
III  and  comparisons  are  made  between  Legendre,  Laguerre, 
Jacobi,  and  backward  prediction-error  adaptive  digital 
filters.  Chapter  V  presents  conclusions  including  limitations 
of  the  orthogonal  polynomial  filters  and  recommendations  for 


further  research. 


II. 


ORTHOGONAL  FUNCTIONS 


A.  THEORY  OF  ORTHOGONAL  FUNCTIONS 

Let  { ( r )  ,  w^{T)  ,  .  .  .  }  denote  a  set  of  real  and  continuous 
functions.  Then  the  system  of  functions  is  said  to  be 
orthogonal  in  the  range  (a,b)  if 


/ 


t ( X  ) 


dx 


K 


for  w  *  n 
for  m  =  n  , 


(1) 


where  is  called  the  norm  of  the  corresponding  function 
[Ref.  3].  The  orthogonal  set  {w^(r)}  is  considered  complete 
if  either  of  the  following  conditions  is  true  [Ref.  2]: 

(1)  There  exists  no  function  x(r)  with 


dx  <  <» 


(2) 


such  that 


j  x{x)  w^(x)  dx  =  0  ,  n  =  0 ,  1,  2 . 


(3) 


(2)  For  any  piecewise  continuous  function  h(r)  with 


j  h  -  (x)  dx  <  oo 

a 


(4) 


and  an  e  >  0,  there  exists  an  integer  N  and  a  polynomial 
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(5) 


n=o 

such  that 

*  N 

f  I  A(t)  -  5^  c^w^ix)  P  Cf-r  <  e  .  (6) 

a  n=0 

Any  stable  causal  system,  h(T)  ,  satisfies  (4)  in  the 
interval  [0,  <»)  and  can  be  represented  by  a  complete  set  of 
orthogonal  functions  [Ref.  2],  Letting  {w^(t)}  represent  a 
complete  set  of  orthogonal  functions  in  the  interval  [0,oo), 
then 

to 

53  for  0  ^  T  S  “  (7) 

n=0 

0  else  , 

where  the  c^  represent  the  expansion  coefficients. 

Albeit  impossible  to  form  an  infinite  sum  of  orthogonal 
functions,  it  is  practical  to  form  a  finite  sum  of  orthogonal 
functions  with  an  accompanying  error,  e,  as  given  by  (6).  It 
is  therefore  possible  to  form  an  approximate  synthesis  of  a 
linear  system,  h(T),  by  forming  finite  linear  combinations  of 
orthogonal  functions: 

liix)  =  I  E  for  0  ^  X  JQJ 

I  n-Q 

[0  else  . 

This,  in  itself,  is  not  particularly  significant,  for 
there  are  other  families  of  functions  that  are  not  orthogonal 
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that  satisfy  (8).  A  Taylor  series  expansion,  for  instance,  is 
never  orthogonal  on  any  interval,  but  it  is  often  effective 
when  approximating  functions  [Ref.  3].  Orthogonal  functions, 
however,  have  several  desirable  characteristics  that  make 
their  use  uniquely  advantageous  when  synthesizing  linear 
systems . 

Whereas  (8)  is  based  on  a  continuous  set  of  orthogonal 
functions,  it  is  also  possible  to  form  an  approximate 
synthesis  of  a  discrete  linear  system,  fi(k),  such  that 

N 

}i{k)  =  ^  c^w^ik)  ,  k  -  0,  1,  2,  .  .  .  ,  (9) 

n  =  Q 

where  {w^(k)}  represents  a  complete  set  of  discrete  orthogonal 
functions,  and  the  expansion  coefficients,  c^,  are  chosen  to 
minimize  the  mean  square  value  of  the  approximation  error. 

B.  CLASSICAL  ORTHOGONAL  POLYNOMIALS 

The  classical  orthogonal  polynomials  form  a  subset  of 
orthogonal  functions.  The  three  classical  orthogonal 
polynomial  families  that  are  included  in  this  research  are  the 
Jacobi,  Legendre,  and  Laguerre.  Other  families  such  as  the 
Chebyshev  and  Hermite  were  found  to  be  unsuitable  for  linear 
system  synthesis  using  the  methods  described  herein. 

The  Legendre  polynomials,  denoted  by  Pn(r)  [Ref.  4],  are 
orthogonal  on  the  interval  [-1,1],  and,  in  the  form  of  (1), 
their  norm  is  given  by 


5 


2  dx  = 


2 

2n  +  1 


(10) 


/  i 

-1 


The  Jacobi  polynomials,  denoted  by  [Ref.  4],  are  also 

orthogonal  on  the  interval  [-1,1]  and  their  norm  is  given  by 


f  (1  -  T)“(l  +  t)M  P  eft 

(11) 

^  r(n^a4i) 

(2fi+a+P+l)  n!  r(r}+a+P+l) 

Note  that  if  a  substitution  is  made  into  (11)  with  both  a  =  0 
and  [B  =  0,  the  result  is  equivalent  to  (10).  Therefore,  the 
Legendre  polynomials  form  a  subset  of  the  Jacobi  polynomials. 
Given  the  orthogonality  interval  of  the  Legendre  and  Jacobi 
polynomials,  [-1,1],  it  is  not  possible  to  make  a  direct 
substitution  of  the  polynomials  into  (7).  The  desired 
orthogonality  interval  for  synthesizing  causal  linear  systems 
is  [0,oo);  thus,  the  orthogonality  interval  of  the  Jacobi  and 
Legendre  polynomials  must  be  shifted  by  means  of  a  change  of 
variables.  Details  of  this  process  are  discussed  in 
chapter  III. 

The  Laguerre  polynomials,  [Ref.  2],  are  orthogonal 

in  the  interval  [0,a)),  making  them  more  readily  applied  to  the 
synthesis  of  linear  systems  than  Jacobi  and  Legendre 
polynomials.  Their  norm  is  given  by 


6 


oo 


(12) 


f  I  IJx)  |-  dt  =  1 


C.  ORTHOGONALITY  OF  THE  LATTICE  PREDICTOR 

Assuming  a  stationary  input  of  random  variables,  each 
stage  of  the  lattice  predictor  is  known  to  produce  a  seguence 
of  uncorrelated  random  variables  in  the  form  of  the  backward 
prediction  errors,  {bQ(k),  b^(k),  •••}  [Ref.  3].  These 
backward  errors  are  orthogonal  in  the  range  [0,oo)  and, 
therefore,  well  suited  for  synthesizing  discrete  linear 
systems  of  the  form 


h(k) 


eo 

.  52  0  S  k  <  ® 

6  else  . 


(13) 


The  lattice  filter  structure  is  a  manifestation  of  the 
Gram-Schmidt  orthogonalizat ion  procedure  insofar  as  the 
generation  of  the  backward  errors  is  concerned.  The  forward 
prediction  errors  associated  with  prediction-error  filters  are 
also  produced  by  each  stage  of  the  lattice  filter.  However, 
their  application  to  linear  system  synthesis  is  not  germane, 
for  the  forward  errors  are  correlated  and,  therefore,  not 
orthogonal  [Ref.  3]. 
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III.  SYSTEM  IDENTIFICATION  AND  MODELING 


A.  ORTHOGONAL  ADAPTIVE  FILTER  MODEL 

Consider  a  system  where  x(k)  denotes  an  input  to  both  a 
causal  linear  system,  h(k),  and  an  adaptive  filter  model,  h(k) 
as  shown  in  Figure  3.1.  Let  d(k)  be  the  desired  output  of  the 
system  and  y(k)  be  the  output  of  the  adaptive  filter. 


X(k) 


d(k) 

System 


e  (k) 


Adaptive 
Filter  y(k) 


Figure  3.1:  System  identification  configuration 

Following  the  derivation  in  [Ref.  1],  the  output  error  is 
given  by 


8 


(14) 


e(^)  =  d(k)  -  y(k) 

k 

-  d(k)  -  52 


j  =  -eo 


}^{k  -  i) 


From  (9),  we  write 

k  N 

e(k)  =  d(k)  -  52  52  ~  ‘ 

1=-“  n=o 


(15) 


where  {w^(k)}  represents  a  complete  set  of  discrete  orthogonal 
functions,  and  the  c^  are  the  expansion  coefficients. 
Rearranging  the  summations  in  (15)  yields 


eik)  =  d(k) 


N  k 

52  <^.-2  52  ( -i )  f  ^  ^  ^ 

/:=0  i*-«» 


(16) 


And  therefore, 


eik)  =  dik)  -  52  =  d(k)  -c^uik)  ,  (17) 

.":=o 


where 

c  =  [Cq,  C- ,  c,.]  ",  (18) 

uik)  =  [u^ik)  ,  u.  (k),  Uj^.(ic)]"  ,  (19) 

and 

k 

u..ik)  =  xii)  w^.{k  -  i)  .  (20) 

j  = 

Figure  3.2  depicts  the  generic  orthogonal  function  model. 
We  consider  each  Q„(z)  to  be  a  black  box  that  has  two  outputs 
when  excited  by  an  impulse:  One  is  an  orthogonal  function 
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u^(k),  and  the  other  is  a  connection  to  the  next  black  box. 
For  the  purposes  of  this  thesis,  we  limit  our  investigation  to 
Legendre,  Jacobi,  Laguerre,  and  backward  prediction-error 
functions  to  model  systems. 


Figure  3.2:  Generic  adaptive  filter  configuration  for 
orthogonal  functions. 

We  wish  to  find  a  set  of  expansion  coefficients  to 
minimize  the  mean  square  error  of  (17).  Using  the  LMS 
algorithm,  we  take  e^(k)  to  be  an  estimate  of  the 
instantaneous  mean  square  error  [Ref.  6].  To  obtain  the 
minimum  mean  square  error,  we  find  the  corresponding  gradient 
estimate  by  taking  the  derivatives  of  e^(k)  with  respect  to 
the  expansion  coefficients; 
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Vik) 


2eik)  u{k) 


(21) 


0  <  ji  ^  ^  .  (24) 

[U(k)  - 

All  simulations  in  this  thesis  set  u  according  to  the 
range  specified  in  (24).  The  expansion  coefficients  are 
updated  after  each  iteration  in  accordance  with  (23). 
Convergence  rates  for  the  expansion  coefficients  vary 
depending  on  model  type  and  order. 


A.  LEGENDRE  POLYNOMIALS 

Recall  from  chapter  II  that  continuous  Legendre 
polynomials  form  a  complete  set  of  orthogonal  functions  in  the 
range  [-1,1]  and  are  defined  as 


11 


r  ,  ,  ,  V  ,  I -  lor  m  =  n 

/  p^{x)p^^x)  dx  =  I  2n  1 

-1  0  for  m  *  n  . 


(25) 


Following  the  derivation  given  by  Lee  [Ref.  2],  a  change 
of  variable  is  made  to  transform  the  orthogonality  range  for 
the  Legendre  polynomials  from  [-1,1]  to  [0,®),  which  is  the 
desired  range  to  correspond  to  the  causal  time  axis.  Letting 
the  first  change  of  variable  be 


T  =  2y 


(26) 


causes  (25)  to  become 


2  /  p_(27  -  l)p„(2y  -  1)  dy  =  <  2r!  +  1 


tor  m  =  n 


0  for  n)  *  n  . 


Letting  the  second  change  of  variable  in  (27)  be 


y  -  e- 


(28) 


where  C  is  any  positive  real  constant,  yields 


I  Ce-'-p„\2Ce^^’  -  l)p.^(2e  -  1)  dl 


-  for  m  =  n 

In  ~  1 

0  for  m  *  n 


(29) 


Now,  defining 


V'.  (  r )  =  v'C  ^  '  P-  (2  e  -  1 : 


(30) 


and  substituting  into  (29)  gives 
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/  dt  =  I  2n->-  1  m  n 

Since  (31)  satisfies  the  definition  of  orthogonality  given  by 
(1),  then  the  set  {v^(t)},  a  shifted  version  of  the  Legendre 
polynomials,  is  an  orthogonal  set  defined  in  the  desired  range 
[0,oo).  From  (7),  h(r)  can  now  be  represented  by  the  series 
given  by 


hiZ)  =  I  E  /or  0  ^  T  ^  =0  (32) 

I 

[  0  else  , 

where,  again,  c^  are  the  expansion  coefficients  chosen  to 
minimize  the  mean  square  error,  and  {v^(t)}  is  the  orthogonal 
polynomial  set  based  on  the  shifted  Legendre  polynomials. 

In  order  to  realize  a  digital  network,  it  is  necessary  to 
generate  the  shifted  discrete  Legendre  polynomials  based  on 
the  continuous  set  {v^(t)}.  It  is  convenient  to  note  the 
first  few  terms  of  the  Legendre  polynomials  [Ref.  7],  {p^{T)}' 


p.Jz)  =  1 
p^ix)  =  T 


(33) 


Substituting  (33)  into  (30),  the  first  few  terms  of  {v^(t)} 
are 


V'  { !■'  =  \^Ce  ■  ' 

V.  {  r )  =  v'?'  (  - 1  +  2  e  )  e  '  '  ( 34 ) 

vv  {  D  =  V  C  '1  -  6  e  ^ +  6  e  )  e  '  '  . 
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Taking  the  Laplace  transform  of  (34)  generates  the  first  few 
terms  of  the  shifted  Legendre  polynomials  in  the  frequency 
domain,  which  are  given  by 


v,(s) 

v^(s) 

V,(s) 


=  /c  - 

=  yjc 

=  /5C 


1 

(S  +  c/2) 

(s  -  C/2) 


(s  +  C/2)  (s  +  3 C/2) 

(s  -  C/2)  (s  -  3 C/2) 

(S  +  c/2)  (s  +  3C/2)  (s  +  5C/2) 


(35) 


From  (35),  it  is  apparent  that  the  general  expression  for 
{V,(s)}  is 


(s  -  C/2)  (s  -  3C/2)  {s  -  (2n  -  l)C/2) 
(s  +  c/2)  (s  +  3C/2)  (s  +  (2/1  +  DC' 2} 


(36) 


for  n=0,  1,  2,  ...,  where 


=  y/j2?ni^TYC  .  (37) 

Of  the  several  techniques  available  for  performing  an 
analog  to  digital  filter  transformation,  the  matched  Z- 
transform  is  best  suited  for  our  purposes.  This  technique 
preserves  the  ability  to  express  the  digital  frequency  terms, 
{V^(z)},  in  a  closed  form  as  in  (36)  and,  more  importantly, 
allows  for  a  filter  structure  that  is  easily  synthesized.  The 
matched  Z-transform  maps  the  poles  and  zeros  of  {V^(s)}  into 
those  of  {V^(z)}  through  the  substitution 

(s  +  a)  -  (1  -  z'^)  ,  (38) 

where  T  represents  the  sampling  period  of  the  discrete- time 
filter  [ Ref  .  8  ]  . 
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Accordingly,  performing  an  analog  to  digital 
transformation  on  (36)  yields  the  first  three  terras  of 
{V„(z)}: 


Vo(z)  = 
V,(Z)  = 
V,{z)  = 


rc 


^JTC  (1  -  _ 

(1  -  (1  - 

yJSC  ( 1  -  (1  - 


(39) 


(i-e-3c/22-i)  (i-e-5‘^/2z-M 

As  noted,  the  raatched  Z-transform  preserves  the  ability  to 
express  the  terras  of  {V^(z)}  in  the  closed  form 


VAz)  = 


A„  (1  -  e^’^z'A  (1  -  e^^‘^-z--)-{\  -  (^0) 


(1  -  (1 


>-3C/2 


z'-)  ■■■  (1 


•(2n‘:)c/22-3) 


for  n=0,  1,  2,  ...,  where 

=  ^irnrrwc  .  (4i) 

The  synthesis  of  a  discrete  system  using  shifted  Legendre 
polynomials  is  accomplished  by  generating  each  Legendre 
polynomial  using  its  corresponding  transfer  function  in  (40). 
Accordingly,  substituting  each  0^(2)  shown  in  Figure  3.3  into 
the  filter  structure  shown  in  Figure  3.2  provides  the 
necessary  filter  structure  to  generate  each  polynomial. 


C.  JACOBI  P0L7N0MIALS 

The  Legendre  polynomials  form  a  subset  of  the  much  larger 
class  of  Jacobi  polynomials.  Like  the  Legendre  polynomials, 
the  Jacobi  polynomials  form  a  complete  set  of  orthogonal 
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Figure  3.3:  Module  of  Legendre  polynomial  adaptive  filter. 

functions  in  the  range  [-1,1]  and,  therefore,  require  a 
transformation  to  shift  the  orthogonality  range  to  [O,*®). 

The  Jacobi  polynomials,  { ( t ) } /  are  defined  as 


I  (1  -  T)“(l 


(T)pJ“''”  (T)  dX  = 


kl  for  m  =  n  (42) 
0  for  m  *  n  , 


where 


^2  ^  r(ri^a*p-l)  r(ri^P^l) 

"  (2r!+a  +  P+l)  o!  r(r2+a  +  P+l) 

Letting  the  first  change  of  variable  be 

T  =  2y  -1 

causes  (42)  to  become 


(43) 


(44) 


16 


I  (t)  (c)  dt  = 


kn  for  w  =  n 
0  for  m  *  n  , 


(49) 


where  is  defined  as  in  (43).  Since  (49)  satisfies  the 

definition  of  orthogonality  given  in  (1),  the  shifted  Jacobi 
polynomials,  { ( t )  } ,  form  an  orthogonal  set  of  polynomials 
in  the  range  [0,<»).  From  (7)  ,  any  causal  system,  h(t),  may 
be  represented  by 
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h  ( t) 


( t )  for  0  ^  5 

else  . 


00 


(50) 


(o,  P) 


.n=C 

0 


In  order  to  synthesize  discrete  linear  systems,  it  is 
necessary  to  generate  the  shifted  discrete  Jacobi  polynomials. 
Let  the  derivation  of  the  shifted  discrete  Jacobi  polynomials 
begin  by  listing  the  first  few  terms  of  the  continuous  Jacobi 
polynomials : 


(t)  1 

=(a-l)  -  (a+p+2)  (t-1) 

p.'“'P'(t)  =  -1  (a+1)  (a+2)  +  (a  +  p+3)  (a+2)  (  c-1) 

+  (a  +  p  +  3)  (a+p+4)  ( t-1)  2) 

8 

Substituting  (51)  into  (48)  yields  the  first  few  terms  of 
{v/“''^^t )  } : 


Vo'“'^’(t)  =  /2C2P'"  (2  -  2e-^=)“'2 

v.;“'^'(£)  =  /2C2P''^  e-c'p*i)c/2  (2  -  2e-“)“'2 

X  [  (a+1)  +  ^  (a  +  p+2)  (2'"'  -  2)  ] 

(t)  =  /2C  2^''^  (2  -  2e''^'')“^^ 

X  [  (  4-  (a  +  l)  (a  +  2) 

2 

+  -i(a  +  P  +  3)  ((a+2)  (2e'‘^'^  -  2) 

+  -^(a  +  P  +  3)  (a  +  P+4)  (20“^^"  -  2)“] 

8 


We  desire  to  obtain  { ( s )  } ,  the  frequency  domain  terms 
of  the  shifted  Jacobi  polynomials;  however,  it  is  not  possible 
to  form  a  general  expression  for  each  term  of  { ( s ) } 
because  the  Laplace  transform  of  (52)  yields  entirely 
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different  results  depending  on  the  value  of  a.  Therefore, 
without  losing  the  generality,  we  make  the  derivation  specific 
to  0=2.0  for  the  remainder  of  this  development. 

Substituting  a  =  2.0  into  (52)  and  taking  its  Laplace 
transform,  we  obtain  the  first  few  terms  of  { ( s )  }  : 


(s) 


is) 


is) 


K-. 


is  + 


)  is  + 


C(P^3) 


) 


K,  is  ~  (C+l)  /6) 


2  2  2 
A'-  [I2s"  -  (4p-8)  Cs  -  (P"+ep  +  5)C2] 

(s.^iPiZiy  ' 

2  2  2  2 


(53) 


where  the  are  constants. 

Unlike  the  Legendre  polynomials,  there  is  no  apparent 
closed  form  expression  to  represent  the  terms  of  { s )  }  . 
The  denominator  terms  can  be  put  into  a  closed  form 
expression,  but  not  the  numerator  terms.  This  is  an  important 
concern,  for  it  is  carried  over  to  the  frequency  terms  of  the 
discrete  shifted  Jacobi  polynomials,  { (  z  )  }  . 

Using  the  matched  Z-transform  method  to  perform  an 
analog  to  digital  transformation  on  the  first  two  terms  in 
(53)  produces  the  first  two  terms  of  { (  z  )  } : 


(z) 

(z) 


_ _ 

(1  -  a^z  '-)  (1  -  a.^z~-) 

K.._  (1  - 

(1  -  a.z^'-)  (1  -  a,z~'-)  (1  -  a^z'^) 


(54) 


where 
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and  the  K„„  are  constants. 

without  a  closed  form  representation  of  the  terms  in  (54), 
the  problem  of  generating  the  discrete  Jacobi  polynomials  is 
considerably  more  demanding  than  that  of  the  Legendre 
polynomials.  Whereas  the  transfer  function  needed  to  generate 
each  of  the  shifted  Legendre  polynomials  is  known  (see  (40)), 
the  transfer  function  needed  to  generate  each  of  the  shifted 
Jacobi  polynomials  must  be  explicitly  derived.  Due  to  the 
complexity  of  the  expressions  involved  ,  it  was  necessary  to 
use  a  symbolic  software  program  called  MACSYMA  uo  generate 
both  the  terms  of  {v^^^'^^(t)}  and  { ( s ) }  .  The  terms  of 
|y^(2,R)^2)}  could  then  be  found  by  transformation. 
Unfortunately,  only  the  first  15  terms  of  { ( z ) }  were 
derived  with  a  =  2.0  and  a  =  4.0  due  to  the  large  size  of  the 
expressions  involved. 

D .  LA6UERRE  POLYNOMIALS 

The  Laguerre  polynomials,  {l^(t)},  form  a  complete  set  of 
orthogonal  functions  in  the  range  [0,co)  and  are  defined  by 

00 

f  J  (t)  J  (t)  dt  =  (  i  for  m  ^  n  (56) 

J  )o  for  m  *  n  . 

0 

Laguerre  polynomials  are  defined  over  the  desired 
orthogonality  range,  [O,®);  thus,  we  can  immediately  proceed 
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with  the  derivation  of  the  discrete  Laguerre  polynomials  that 
are  needed  to  synthesize  discrete  linear  systems.  The  first 
few  terms  of  {l^(t)}  are: 


l,(t)  =  /2C 

l.Jt)  =  >/2C  i2Ct  ~  l)e-“  (57) 

J-(t)  =  v^(2C^t^  -  4Ct  +  , 

where  C  is  any  positive  real  constant.  Taking  the  Laplace 
transform  of  (57),  we  have 

'^TTTcT 

L.(s)  ,58, 

LAs)  =  ~  . 

(s  +  O' 


Using  the  matched  Z-transform  technique  to  perform  an  analog 
to  digital  transformation  on  (58)  yields 


Iq(Z) 

L-  (z) 
L-  (A 


=  /2C 

=  ySc 

=  /Jc 


1 _ 

(1  - 

(1  -  e^z'^) 
(1  -  ^ 
(1  -  e^z~'^)  ^ 
(1  -  ^ 


(59) 


The  closed  form  general  expression  for  the  terms  in  (59)  is 

LAz)  =  ~  .  (60) 

(1  -  e-'-'z'') 

Notice  that  all  zeros  of  (59)  are  located  at  2  =  e'-  ,  and  all 
poles  are  located  at  z=e'^.  The  synthesis  of  any  linear  system 
using  Laguerre  polynomials  is  accomplished  by  generating  each 
Laguerre  polynomial  using  its  corresponding  transfer  function 
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given  in  (60).  Accordingly,  substituting  each  Qn(z)  in  Figure 
3.4  into  the  structure  shown  in  Figure  3.2  provides  the 
necessary  filter  structure  to  generate  the  polynomials. 


Qn(z) 


Figure  3.4:  Module  of  Laguerre  polynomial  adaptive  filter. 

E.  LATTICE  PREDICTOR 

Let  {bg(k),  b^(k),  ...,  b^(k)}  denote  the  first  N+1 

backward  prediction  errors  associated  with  a  backward 
prediction  error-filter.  If  x(k)  is  a  stationary  input  of 
random  variables  to  a  backward  prediction-error  filter,  it  can 
be  shown  that  the  backward  errors  are  orthogonal,  that  is, 

E[bjk)  bjk)]  =  ^  (61) 

"  "  [0  for  m  *  n  , 

where  E[]  is  the  expectation  operator.  Following  the  proof 
given  by  Haykin  [Ref.  5],  we  write 
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(62) 


bjk)  =  Y,  -  1)  xik  -  1)  , 

1=0 

where  a|^(l),  1  =  0,  1,  .  .  . ,  m,  are  the  coefficients  of  a 
prediction-error  filter  of  order  m.  Substituting  (62)  into 
(61)  yields 

[  m  n 

E[b^ik)  b^ik)  ]  =  £■  15]  Y  ~  ~  P'>  ~  -  P'> 

11=0  P-0 

.7?  n 

=  5]  ~  P'>  ^.xik  -  1)  xik  -  p)] 

1=0  p=C 
m  n 

=  E  E  -  p)^Jp  -  -Z)  / 

1=0  p=Q 

(63) 

where  r^(p-l)  denotes  the  correlation  function.  The  normal 
equations  for  a  backward  prediction-error  filter  are  given  by 
[Ref.  5] 

t  a,in-p)  r,(p-i)  =  |  j  ;  "  («) 

Substituting  (64)  into  (65),  we  find 

Eib^ik)  b^ik)]  for  m  =  n  (65) 

A  lattice  predictor  structure  is  commonly  used  to  generate 
the  backward  errors.  The  lattice  structure  shown  in  Figure 
3.5  utilizes  the  backward  errors  in  an  adaptive  filter.  Let 
the  transfer  function  needed  to  generate  each  {b^(k)}  be 
denoted  by 
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A„{z) 


X{z) 


(66) 


By  comparing  Figure  3.5  to  Figure  3.2  we  note  that  Aj^(z)  has 
a  definite  relationship  to  Q„(z) .  The  exact  relationship 
could  be  found  by  evaluating  each  A^(z)  using  the  signal  flow 
graph  in  Figure  3.5.  Furthermore,  it  is  apparent  that 
u^(k)  =  br,(k)  ,  and,  thus,  the  backward  prediction-errors  could 
be  said  to  form  a  family  of  orthogonal  polynomials.  The 
synthesis  of  a  linear  system  is  accomplished  by  forming  linear 
combinations  of  the  backward  prediction-error  polynomials. 


x(k) 


'z  ■  ^ 


- 1- 


t>o(k)  b^(k)  bj^.i(k) 


1 - 


b  (k) 

N 


N- 1 


C 


N 


y  (k) 


Figure  3.5;  Lattice  predictor  adaptive  filter. 
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IV.  SIMULATION  RESULTS 


A.  FIR  BANDPASS  FILTER  SIMULATIONS 

For  the  purpose  of  evaluating  the  FIR  system  modeling 
performance  of  the  orthogonal  polynomials,  two  bandpass  FIR 
filters  were  chosen  as  the  systems  to  be  identified.  The  FIR 
filters  were  designed  for  filter  orders  of  22  and  71,  with 
cutoff  frequencies  of  0.1  and  0.2  (fraction  of  sampling 
frequency).  Each  filter  was  excited  by  a  zero-mean  Gaussian 
white  noise  sequence  with  unit  variance.  The  desired  output 
sequence  was  compared  against  the  output  of  the  orthogonal 
network,  and  the  error  was  used  to  update  the  expansion 
coefficients . 

Figure  4.1  shows  the  impulse  and  frequency  response  plots 
of  an  18^^  order  Legendre  adaptive  digital  filter  (ADF)  with 
C  =  0.11  when  used  to  model  a  22"*^  order  FIR  system.  Notice 
that  the  Legendre  filter  has  an  infinite  impulse  response  that 
allows  smaller  order  Legendre  filters  to  model  larger  order 
FIR  systems.  In  this  case  an  18^^  order  model  is  used  for  a 
22"'*  system,  which  is  roughly  an  18%  savings  in  terms  of  the 
filter  order.  Figure  4.2  shows  a  52"'*  order  Legendre  ADF  model 
with  C  =  0.075  used  to  model  a  71®^  order  FIR  system,  which  is 
approximately  a  27%  savings  in  terms  of  the  filter  order. 
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0.2 

0 

-0,2 

0  5  10  15  20  25  3  0  35  4  0  45  5  0 

Sample 

Legendre  ADF 
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^  _ _ 1 _ i 

0  '  0,05  Od  0T5  '  (X2  0.25  *  0.3  0,35  0.4  0.45  0.5 

Fraction  of  Sampling  Frequency 

Figure  4.1;  Impulse  and  frequency  response  of  an  18^'^  order 
Legendre  ADF  used  to  model  a  22'^'^  order  FIR  filter. 


Impulse  Response;  Desired  Versus  Legendre  ADF 


Sample 
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Frequency  Response:  Desired  Versus  Legendre  ADF 


50 . - ..  - - . - - - ^ . - - - . - . - - 

0  0.05  0.1  0.15  0.2  0.25  0.3  0.35  0.4  0.45  0,5 


Fraction  of  Sampling  Frequency 


Figure  4.2:  Impulse  and  frequency  response  of  a  52"*^  order 
Legendre  ADF  used  to  model  a  71*^  order  FIR  filter. 
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The  convergence  of  the  first  six  expansion  coefficients 
for  the  18^*’  order  Legendre  ADF  and  the  resulting  filter  output 
error  are  shown  in  Figure  4.3.  Notice  that  all  coefficients 
converge  by  the  200^^  sample,  which  implies  we  need  an  input 
sequence  that  has  approximately  10  times  more  samples  than  the 
order  of  the  system  to  be  modeled. 


3 

n 

> 


c 

o 


u 

U 


(a)  Convergence  of  Legendre  ADF  Coefficients 


0. 1  ^ ^ - - - - - - - - ! 

0  100  200  300  400  500  600  700 


Sample 

(b)  Legendre  ADF  Output  Error 


‘'u  lUO  200  300  400  500  600  700 
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Figure  4.3:  (a)  Convergence  of  first  six  expansion 
coefficients  and  (b)  Output  error  for  an  18^^  order  Legendre 
ADF  used  to  model  the  22"*^  order  FIR  system. 

The  performance  results  when  an  18^^  order  Laguerre  ADF 
with  C  =  0.98  is  used  to  model  the  22"*^  order  FIR  system  is 
shown  in  Figure  4.4.  The  fact  that  the  results  are  comparable 
to  the  Legendre  ADF  is  not  surprising,  for  the  transfer 
functions  needed  to  generate  both  sets  of  polynomials  have  the 
same  number  of  poles  and  zeros  (see  (40)  and  (60)).  Likewise, 
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Figure  4.5  shows  the  result  of  a  52'’*^  order  model  with  C  =  0.98 
used  to  model  the  71®^  order  FIR  system. 


Sample 


Fraction  of  Sampling  Frequency 

Figure  4.4:  Impulse  and  frequency  response  of  an  18^'^  order 
Laguerre  ADF  used  to  model  a  22"*^  order  FIR  filter. 

We  expect  an  improvement  in  performance  when  using  the 
Jacobi  ADF,  for  the  transfer  function  needed  to  generate  each 
Jacobi  polynomial  has  more  poles  than  that  needed  to  generate 
the  Legendre  and  Laguerre  polynomials.  Exactly  how  many  more 
poles  are  realized  depends  on  the  value  of  a.  In  the  case 
where  a  -  4.0,  two  more  poles  are  realized  in  each  transfer 
function  that  generates  the  corresponding  Jacobi  polynomial. 
Figure  4.6  shows  the  results  of  a  15^'^  order  Jacobi  simulation 
with  {C,  a,  3}  =  {0.002,  4,  1000}  when  used  to  model  the  22'’'^ 
order  FIR  system. 
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Sample 


Fraction  of  Sampling  Frequency 


Figure  4.5.  Impulse  and  frequency  response  of  an  52'^'^  order 
Laguerre  ADF  used  to  model  a  71**  order  FIR  filter. 


Figure  4.6:  Impulse  and  frequency  response  of  a  IS*'’  order 
Jacobi  ADF  used  to  model  a  22"**  order  FIR  filter. 
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Note  that  the  frequency  response  of  the  Jacobi  model  is 
significantly  better  in  the  lower  end  of  the  spectrum  than  in 
the  higher  end.  This  can  be  attributed  to  the  fact  that  the 
frequency  response  of  each  Jacobi  polynomial  has  lowpass 
characteristics;  therefore,  it  is  not  surprising  that  a  linear 
combination  of  Jacobi  polynomials  would  perform  better  when 
modeling  frequencies  in  the  lower  end  of  the  frequency 
spectrum.  The  same  is  true  for  both  the  Legendre  and  Laguerre 
polynomials.  The  71®^  order  FIR  system  was  not  modeled  using 
the  Jacobi  polynomials  due  to  the  difficulties  encountered  in 
determining  the  transfer  functions  of  the  higher  order  Jacobi 
polynomials  as  discussed  in  part  C  of  chapter  III. 

Unlike  the  Legendre,  Laguerre,  and  Jacobi  filters,  the 
lattice  filter  structure  has  a  finite  impulse  response.  The 
15^^  order  Lattice  model  produces  comparable  results  to  that 
of  the  classical  orthogonal  polynomial  models  when  used  to 
model  the  22"'^  order  FIR  system  (see  Figure  4.7).  Although  the 
lattice  filter  has  a  finite  impulse  response,  Figure  4.8  shows 
that  a  52"'^  order  lattice  filter  is  able  to  effectively  model 
a  71^^  order  FIR  system. 
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Figure  4.7:  Impulse  and  Frequency  response  of  a  15^*^  order 
lattice  ADF  used  to  model  a  22"^  order  FIR  filter. 
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Figure  4.8;  Impulse  and  frequency  response  of  a  52"*^  order 
lattice  ADF  used  to  model  a  71*^  order  FIR  filter. 
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B.  HR  BANDPASS  FILTER  SIMULATIONS 


As  with  the  FIR  filters,  two  Butterworth  HR  bandpass 
filters  were  designed  to  evaluate  the  HR  modeling  performance 
of  the  orthogonal  ADFs.  The  HR  filters  were  designed  for 
filter  orders  of  7  and  31,  with  cutoff  frequencies  of  0.1  and 
0.2.  Since  an  order  HR  filter  has  2N  coefficients,  our 
aim  is  to  use  orthogonal  function  adaptive  models  with 
approximately  2N  coefficients.  The  results  herein  show  the 
lowest  order  ADF  models  that  demonstrated  satisfactory 
performance . 

Figure  4.9  shows  a  15^^  order  Legendre  ADF  with  C  =  0.075 
used  to  model  the  7^^  order  Butterworth  HR  filter.  Notice 
that  the  Legendre  ADF  does  not  model  the  low  order  HR  system 
as  well  as  the  low  order  FIR  system  as  shown  in  Figure  4.1. 
The  HR  filters  are  difficult  to  model  because  the  structure 
of  the  orthogonal  adaptive  filters  more  closely  resembles  a 
FIR  filter  (see  Figure  3.2). 

Figure  4.10  shows  a  65^^  order  Legendre  ADF  with  C  =  0.055 
used  to  model  the  31®^  order  HR  filter.  Notice  that  the 
impulse  response  of  the  HR  filter  is  still  significant  beyond 
140  samples,  but  the  impulse  response  of  the  ADF  does  a  poor 
job  of  duplicating  it. 

As  in  the  FIR  case,  the  Laguerre  ADF  performance  is 
similar  to  that  of  the  Legendre  ADF.  Figure  4.11  shows  a  15^^ 
order  Laguerre  ADF  with  C  =  0.98  modeling  a  7^^  order  HR 
filter.  There  is  marked  increase  in  performance  when  the 
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Figure  4,9:  Impulse  and  frequency  response  of  a  15^^  order 
Legendre  ADF  used  to  model  a  7^^  order  HR  filter. 
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Figure  4.10:  Impulse  and  frequency  response  of  a  65^^  order 
Legendre  ADF  used  to  model  a  31®^  order  HR  filter. 
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order  of  the  system  being  identified  is  increased. 
Figure  4.12  shows  that  the  31*^  order  HR  system  can  be  modeled 
with  a  65^^  order  ADF.  The  Laguerre  ADF  has  better  performance 
characteristics  than  the  Legendre  ADF  (see  Figure  4.10)  in 
both  the  passband  and  the  stopband. 
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Figure  4.11:  Impulse  and  frequency  response  of  a  15^*’  order 
Laguerre  ADF  used  to  model  a  7^^  order  HR  filter. 


A  15^^  order  Jacobi  adaptive  filter  with  parameters 
{C,a,f3}  =  {0.0015,  4.0,  925.0}  was  used  to  model  the  7^^  order 
HR  filter,  and  the  plots  of  the  model's  impulse  and  frequency 
response  are  shown  in  Figure  4.13.  It  appears  that  the  two 
additional  poles  in  the  Jacobi  transfer  functions  do  not 
significantly  increase  low  order  modeling  performance  when 
compared  to  the  Legendre  and  Laguerre  polynomials.  However, 
there  is  a  possibility  that  other  parameter  sets,  {C,  a,  3}/ 
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Figure  4.12:  Impulse  and  frequency  response  of  a  65^^  order 
Lagnerre  ADF  used  to  model  a  31®^  order  HR  filter. 
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Figure  4.13:  Impulse  and  frequency  response  of  a  order 

Jacobi  ADF  used  to  model  a  7''’  order  HR  filter. 
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do  exist  that  would  produce  better  results. 

The  15^^  order  lattice  ADF  simulation  of  the  7^^  order  IIR 
filter  is  shown  in  Figure  4.14.  As  with  the  FIR  case,  the 
lattice  filter  performs  better  when  modeling  smaller  order 
systems.  Notice  the  poor  performance  of  the  65^^  order  lattice 
ADF  when  modeling  the  31®^  order  IIR  filter  as  shown  in 
Figure  4.15.  The  reason  the  lattice  filter  performs  worse 
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Figure  4.14:  Impulse  and  frequency  response  of  a  15^^  order 
lattice  ADF  used  to  model  a  order  IIR  filter. 

than  the  classical  orthogonal  polynomial  filters  is  that  it 
has  a  finite  impulse  response,  which  restricts  it  ability  to 
model  higher  order  IIR  systems. 
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Figure  4.15:  Impulse  and  frequencv  response  of  a  65^^  order 
lattice  ADF  used  to  model  a  31®^  order  IIR  filter. 
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V.  CONCLUSIONS 


There  are  several  characteristics  of  orthogonal  filter 
models  that  make  their  use  attractive.  The  classical 
orthogonal  function  filters  are  particularly  adept  at  modeling 
systems  with  long  impulse  responses.  FIR  systems  with  large 
orders  (say,  greater  than  70)  can  generally  be  modeled  with 
25-30%  fewer  coefficients  using  the  orthogonal  ADFs .  Large 
order  HR  systems  can  commonly  be  modeled  with  the  same  number 
of  coefficients  that  are  in  the  HR  system.  The  research  in 
this  thesis  has  only  evaluated  the  pcrforrr-nce  of  the 
orthogonal  ADF  models  when  used  to  identify  bandpass  FIR  and 
HR  filters.  It  is  quite  possible  that  systems  with  strictly 
lowpass  or  highpass  characteristics  could  be  modeled  with 
varying  degrees  of  success.  Although  the  orthogonal  function 
filter  models  have  shown  considerable  promise,  there  are 
several  limitations  that  must  be  addressed;  recommendations 
for  future  research  are  also  presented. 

A.  LIMITATIONS  OF  ORTHOGONAL  FILTER  MODEL 

Previous  research  has  shown  that  the  convergence  rate  for 
the  LMS  expansion  coefficients  is  increased  when  using 
orthogonal  functions  [Ref.  1].  Even  so,  the  length  of  the 
input  sequence  must  be  increased  when  the  desired  filter  order 
is  increased  in  order  to  allow  the  expansion  coefficients 
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sufficient  time  to  converge.  Typically,  the  input  sequence 
must  have  a  length  that  is  10  to  15  times  greater  than  the 
desired  model  order.  This  fact  places  limitations  on  the 
orthogonal  functioii  models,  for  large  order  models  require 
long  input  sequences . 

The  selection  of  the  positive  real  constant,  C,  will 
significantly  influence  the  performance  of  the  Legendre, 
Laguerre,  and  Jacobi  adaptive  filters.  Furthermore,  the 
Jacobi  polynomials  have  two  additional  parameters,  a  and  B, 
that  must  be  chosen  for  any  given  simulation.  There  is 
currently  no  known  algorithm  for  optimizing  the  selection  of 
these  parameters.  Therefore,  evaluating  the  performance  of 
the  orthogonal  function  filters  is  largely  a  matter  of  trial 
and  error. 

The  theory  for  the  classical  orthogonal  function  filters 
was  derived  in  the  continuous  time  and  frequency  domains.  The 
matched  Z-transform  technique  was  used  to  map  the  poles  and 
zeros  of  the  orthogonal  filters  from  the  s-domain  to  the  z- 
domain.  Unfortunately,  the  m.atched  z-transform  technique  was 
found  to  introduce  errors  concerning  the  orthogonality  of  the 
filter  output  sequences.  Other  analog  to  digital 
transformations  appear  no  more  attractive,  for  their  use  would 
eliminate  the  ability  to  express  the  filter  transfer  functions 
in  a  closed  form,. 
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B.  RECOMMENDATIONS  FOR  FURTHER  RESEARCH 


An  algorithm  to  determine  the  selection  of  the  positive 
real  constant,  C,  is  needed  to  reduce  the  trail  and  error 
nature  of  the  classical  orthogonal  filter  models.  Further 
exploration  of  the  Jacobi  polynomials  is  bound  to  yield 
improved  results,  for  little  is  known  concerning  the  effect  of 
altering  a  and  R .  The  application  of  orthogonal  filter  models 
to  a  broad  range  of  systems  should  be  explored.  Because  the 
classical  orthogonal  polynomials  are  lowpass  in  nature,  their 
application  may  be  limited. 


40 


LIST  OF  REFERENCES 


[1]  H.  Perez  and  S.  Tsujii,  "A  System  Identification  Algorithm 
Using  Orthogonal  Functions,"  IEEE  Transactions  on  Signal 
Processing,  vol.  39,  no.  3,  pp,  752-754,  Mar.  1991. 

[2]  T.W.  Lee,  Statistical  Theory  of  Communications.  New  York: 
Wiley,  1967. 

[3]  P.  Beckmann,  Orthogonal  Polynomials  for  Engineers  and 
Physicists.  Boulder,  CO:  The  Golem  Press,  1973. 

[4]  Handbook  of  Mathematical  Formulas,  Tables,  Graphs, 
Functions,  Transforms ,  pp.  627-63,  Research  and  Education 
Association,  1980. 

[5]  S.  Haykin,  Modern  Filters.  New  York:  Macmillan 

Publishing  Company,  1989. 

[6]  B.  Widrow  and  S.  Stearns,  Adaptive  Signal  Processing . 
Englewood  Cliffs,  NJ:  Prentice-Hall,  1985. 

[7]  CRC  Handbook  of  Mathematical  Sciences,  6^^  ed.,  CRC  Press, 
Inc . 

[8]  R.  Strum  and  D.  Kirk,  First  Principles  of  Discrete  Systems 
and  Digital  Signal  Processing .  Reading,  MA:  Addison-Wesley 
Publishing  Company,  INC,  1989. 


41 


INITIAL  DISTRIBUTION  LIST 


No.  of  Copies 

1.  Defense  Technical  Information  Center  2 

Cameron  Station 

Alexandria,  Virginia  22304-6145 

2.  Library,  Code  52  2 

Naval  Postgraduate  School 

Monterey,  CA  93943-5002 

3.  Chairman,  Code  EC  1 

Department  of  Electrical  and 

Computer  Engineering 
Naval  Postgraduate  School 
Monterey,  CA  93943-5000 

4.  Professor  Murali  Tummala,  Code  EC/Tu  2 

Department  of  Electrical  and 

Computer  Engineering 
Naval  Postgraduate  School 
Monterey,  CA  93943-5000 

5.  Professor  Roberto  Cristi,  Code  EC/Cr  1 

Department  of  Electrical  and 

Computer  Engineering 
Naval  Postgraduate  School 
Monterey,  CA  93943-5000 

6.  Dr.  R.  Madan  (Code  1114SE)  1 

Office  of  Naval  Research 

800  North  Quincy  Street 
Arlington,  Virginia  22217-5000 

7.  Mr.  John  Hager  (Code  70E1)  1 

Naval  Undersea  Warfare  Engineering  Station 
Keyport,  Washington  98345 

8.  Mr.  Samuel  J.  Frazier  (Code  SY84)  1 

Naval  Air  Warfare  Center 

Patuxent  River,  Maryland  20670 

9.  Commanding  Officer  2 

Attn:  LT  Steven  J.  McPhillips,  USN 

Naval  Surface  Warfare  Center 
Dahlgren,  VA  22448-5000 


42 


